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Abstract- In this paper, we consider multiple mobile agents moving in Euclidean 
space with point mass dynamics. Using a coordination control scheme, we can make 
the group generate stable flocking motion. The control laws are a combination of at- 
tractive/repulsive and alignment forces, and the control law acting on each agent relies 
on the position information of all agents in the group and the velocity information of 
its neighbors. By using the control laws, all agent velocities become asymptotically the 
same, collisions can be avoided between all agents, and the final tight formation mini- 
mizes all agent global potentials. Moreover, we show that the velocity of the center of 
mass is invariant and is equal to the final common velocity. Furthermore, we study the 
motion of the group when the velocity damping is taken into account. We prove that the 
common velocity asymptotically approaches zero, and the final configuration minimizes 
the global potential of all agents. In this case, we can properly modify the control scheme 
to generate the same stable flocking. Finally, we provide some numerical simulations to 
^ ■ further illustrate our results. 

Keywords — Collective behavior, swarms, robot teams, coordination, flocking, asym- 
metric interactions, multi-agent systems, collision avoidance, stability. 
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In nature, flocking can be found everywhere and it can be regarded as a typical behavior 
of large number of interacting dynamic agents. This exists in the form of flocking of 
birds, schooling of fish, and swarming of bacteria. Understanding the mechanisms and 
operational principles in them can provide useful ideas for developing distributed coop- 
erative control and coordination of multiple mobile autonomous agents/robots. In recent 
years, distributed control/coordination of the motion of multiple dynamic agents/robots 
has emerged as a topic of major interest PQ [I]. This is partly due to recent technological 
advances in communication and computation, and wide applications of multi-agent sys- 
tems in many engineering areas including cooperative control of unmanned aerial vehicles 
(UAVs), scheduling of automated highway systems, schooling for underwater vehicles, at- 
titude alignment for satellite clusters and congestion control in communication networks 

*This work was supported by the National Natural Science Foundation of China (No. 10372002 and 
No. 60274001) and the National Key Basic Research and Development Program (No. 2002CB312200). 
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[E] [B]- Correspondingly, there has been considerable effort in modelling and exploring the 
collective dynamics in physics, biology, and control engineering, and trying to understand 
how a group of autonomous creatures or man-made mobile autonomous agents/robots 
can cluster in formations without centralized coordination and control |lUj-|23j. 

In order to generate computer animation of the motion of flocks, Reynolds |D] modelled 
the boid as an object moving in a three dimensional environment based on the positions 
and velocities of its nearby flockmates and introduced the following three rules (named 
steering forces) Pj: 

1) Collision Avoidance: avoid collisions with nearby flockmates, 

2) Velocity Matching: attempt to match velocity with nearby flockmates, and 

3) Flock Centering: attempt to stay close to nearby flcokmates. 

Subsequently, Vicsek et al. [TO] proposed a simple model of autonomous agents (i.e., 
points or particles). In the model, all agents move at a constant identical speed and each 
agent updates its heading as the average of the heading of agent itself with its nearest 
neighbors plus some additive noise. They demonstrated numerically that all agents will 
eventually move in the same direction, despite the absence of centralized coordination and 
control. In fact, Vicsek's model can be seen as a special case of Reynolds's model, and it 
only considers the velocity matching between agents. Jadbabie et al. 11] and Savkin ^2] 
used two kinds of completely different methods to provide the theoretical explanation for 
the observed behaviors in Vicsek's model, respectively. According to the results in [5], 
Tanner et al ^3] studied a swarm model that consists of multiple mobile agents moving 
on the plane with double integrator dynamics. They introduced a set of control laws that 
enabled the group to generate stable flocking motion and provided strictly theoretical 
justification. However, it is perhaps more reasonable to take the agents' masses into 
account and consider the point mass model in which each agent moves in n-dimensional 
space based on the Newton's law. In this paper, we investigate the collective behavior of 
multi-agent systems in n-dimensional space with point mass dynamics. 

In [TH], the authors used an undirected graph to describe the neighboring relations 
between agents, which means that the neighboring relations are mutual. In other words, 
they only considered the case with bidirectional information exchange between agents. 
However, under some circumstances, the information exchange is not mutual. In fact, due 
to the agent differences, they maybe have different action forces on different agents and 
even have different sense ranges, hence, the influence intensities between two agents might 
be different with each other and even their information can not be exchanged with each 
other at all. For example, in a group of agents with spherical sense neighborhoods but with 
different radii of the neighborhoods or a group of agents with conic sense neighborhoods, 
the information exchange among them might be unidirectional. A group of mobile robots 
with conic vision range is just an example. In this paper, the results in ^3] are extended 
to a directed graph. We consider the stability properties of the group in the case of 
directed information exchange. In order to generate stable flocking, we introduce a set of 
control laws so that each agent regulates its velocity based on a fixed set of "neighbors" 
and regulates its position such that its global potential become minimum. Note that, in 
this paper, we only consider the fixed topology of the neighboring relations, and the case 
that the information topology is dynamic will be discussed in another paper. Here, the 
control laws are a combination of attractive/repulsive and alignment forces. By using 
the control laws, all agent velocities become asymptotically the same, collisions can be 
avoided between all agents, and the final tight formation minimizes all agent potentials. 
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This paper is organized as follows: In Section 2, we formulate the problem to be 
investigated. Some basic concepts and results in graph theory are provided in Section 
3. We analyze the system stability with some specific control laws in Section 4. Some 
numerical simulations are presented to further illustrate our results in Section 5. Finally, 
we briefly summarize our results in Section 6. 

2 Problem Formulation 

We consider a group of N agents moving in an n-dimensional Euclidean space, each has 
point mass dynamics described by 

x % = v\ 
rriiV 1 = u\ i — 1, • • • , N, 

where x % = (x[, • • • , x l n ) T G R n is the position vector of agent i; v l = (v\, • • • , v l n ) T G R n is 
its velocity vector, m« > is its mass, and u % = (u\, ■ ■ ■ ,m^) t G R n is the (force) control 
input acting on agent i. x 1 ^ = x % — x J denotes the relative position vector between agents 
i and j. 

Our aim is to make the whole group move at a common velocity and maintain constant 
distances between all agents. We first consider the ideal case, that is, we ignore the velocity 
damping. In order to achieve our objective, we try to decrease the velocity differences 
between agents, and at the same time, regulate their distances such that their global 
potentials become minimum. Hence, we choose the control law for each agent to be a 
combination of two components. The control input u 1 for agent i is 

u l = a 1 + ft, (2) 

where a 1 is used to regulate the potentials among agents and (3 l is used to regulate the 
velocity of agent % to the weighted average of its "neighbors" . a 1 is derived from the social 
potential fields which is described by artificial social potential function, V 1 , which is a 
function of the relative distances between agent % and its flockmates. Collision-free and 
cohesion in the group can be guaranteed by this term. Note that a % indicates the tendency 
of collision avoidance and cohesion of the flocks, whereas p 1 indicates the tendency of agent 
velocity matching. 

Certainly, in some cases, the velocity damping can not be ignored. For example, the 
objects moving in viscous environment and the mobile objects with high speeds, such 
as air vehicles, are subject to the influence of velocity damping. Then, under these 
circumstances, the model in (JI} should be the following form 

x % = v l , 
rriiV 1 = u l — kiV 1 , 

where ki > is the "velocity damping gain", —kiV 1 is the velocity damping term, and u l 
is the control input for agent i. Note that we assume the damping force is in proportion 
to the magnitude of velocity. And, because the "velocity damping gain" is determined 
by the shape and size of the object, the property of medium, and some other factors, we 
assume that the damping gains fcj, i = 1, • • • ,N are not equal to each other. Certainly, 
in some cases, the assumption of the same gain is enough. In order to achieve our aim, 
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(3) 



the velocity damping should be cancelled by some terms in the control laws. Thus, we 
modify the control scheme to be 

v* = a* + ft + k iV \ (4) 

3 Main Results 

In this section, we investigate the stability properties of multiple mobile agents with 
point mass dynamics described in ([!}. We present explicit control input in (J2J) for the 
terms a 1 and ft. In this paper, the control law acting on each agent is based on two 
kinds of information topologies that is the position information topology and the velocity 
information topology. We will employ algebraic graph theory as basic tools to study 
the properties of the group. Some concepts and results in graph theory are given in the 
Appendix. 

In this paper, we assume that each agent is equipped with two onboard sensors: the 
position sensor which is used to sense the position information of the flockmates and the 
velocity sensor which is used to sense the velocity information of its neighbors, and assume 
that all the sensors can sense instantaneously. Correspondingly, we define two kinds of 
structure topologies to describe the neighboring relations between the agents. We will use 
an undirected graph Q to describe the position sensor information flow and use a weighted 
directed graph T> to describe the velocity sensor information flow. 

First, we make the following definitions and assumptions. 

Definition 1: (Position neighboring graph) The position neighboring graph, Q = 
(V, £), is an undirected graph consisting of a set of vertices, V = ■ • • ,n N }, indexed 
by the agents in the group, and a set of edges, £ = {{n^rij) G V x V | rij ~ rij}, which 
contain unordered pairs of vertices that represent the position neighboring relations. 

Definition 2: (Velocity neighboring graph) The velocity neighboring graph, T> = 
(V, £), is a directed graph consisting of a set of vertices, V = {ni, ■ ■ • ,n^}, indexed by 
the agents in the group, and a set of arcs, £ = { (n i? rij) 6 V x V | rij ~ rij}, which contain 
ordered pairs of vertices that represent the velocity neighboring relations. 

Note that, in £, an arc (rij, rij) represents a unidirectional velocity information ex- 
change link from to rij, which means that agent i can sense the velocity of agent j. 

Assumption 1: The position neighboring graph Q is complete. 

In order to make the final potential of each agent be global minimum and at the same 
time, ensure collision-free in the group, we assume that the position neighboring graph 
is complete. This means that, each agent can always obtain the position information 
of all the other agents in the group. Certainly, in the case that the position neighboring 
relation is determined by a certain neighborhood around the agent and consequently cause 
the topology of the neighboring graph Q to be dynamic, we can also guarantee collision 
avoidance in the group. 

Assumption 2: The velocity neighboring graph T> is weakly connected. 

In this paper, we consider a group of mobile agents with fixed topology, so V is 
weakly connected and does not change with time. Denote the set A/i = {j | Ojj > 0} C 
{1, • • • , A}\{i} which contains all neighbors of agent i. If agent j is a neighbor of agent 
i, we denote j ~ i, and otherwise we denote j oo i. 

Definition 3 (Potential function) Potential V 1 ^ is a different iable, nonnegative, 
radially unbounded function of the distance H between agents % and j, such that 
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i) V ij (\\x ij \\) ^ooas \\x ij \\ -> 0, 

ii) V lJ attains its unique minimum when agents i and j are located at a desired 
distance. 

Functions V l \ i, j = 1, • • • , N are the artificial social potential functions that govern 
the interindividual interactions. Cohesion and separation can be achieved by artificial 
potential fields One example of such potential function is the following 

b 

V*(x) = alnx 2 + — , 
x l 

where x G R + = (0, oo) is variable, a > and b > are some constants. It is easy to see 
that V* attains its unique minimum when x = sjb/a. Hence, when the distance \\x l — x J \\ 
between agents i and j is ybja, the potential function attains its unique minimum. 
By the definition of V % \ the total potential of agent % can be expressed as 

N 

v* = E ^(il^'ID- (5) 

Agent dynamics are different in ideal case (i.e., velocity damping is ignored) and 
nonideal case. This means that the agent has different motion equations in the two cases. 
Hence, in what follows, we will discuss the motion of the group in the two different cases, 
respectively. 

3.1 Ideal Case 

In this case, in order to achieve our control aim, we take the control law u % to be 

JV 

u l = -J2^' 1 -^)- E V^V* (6) 

Note that, Wij > 0, and Wa = 0, i, j = 1, ■ ■ ■ , N represent the interaction coefficients. 
And Wij > if agent j is a neighbor of agent i, and is otherwise. We denote W = [w^]. 
Thus, by the weakly connectivity of the velocity neighboring graph, W+W T is irreducible. 
The control law in © implies that we adopt the local velocity regulation and the global 
potential regulation to achieve our aim. 

In the discussion to follow, we will need the concept of weight balance condition defined 
below: 

Weight Balance Condition [20J: consider the weight matrix W = \wij\ G R NxN , for 

all i — 1, • • • , N, we assume that J2f=i w ij = ^2f=i w ji- 

The weight balance condition has a graphical interpretation: consider the directed 
graph associated with a matrix, weight balance means that, for any node in this graph, 
the weight sum of all incoming edges equals the weight sum of all outgoing edges [23] . The 
weight balance condition can find physical interpretations in engineering systems such as 
water flow, electrical current, and traffic systems. 

Proposition 1: Let D be a weighted directed graph such that the weight balance 
condition is satisfied. Then D is strongly connected if and only if it is weakly connected. 

Proof: It is obvious that if T> is strongly connected, then it is weakly connected. 
Hence, we only need to prove that if T> is weakly connected, then it is strongly connected. 
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In the following, we will use the way of contradiction to prove it. Assume that T> is weakly 
connected, but not strongly connected, then we denote all strongly connected components 
of T> as T>i, ■ ■ ■ , D m , where m is an integer and m > 1. If there is an arc starting in T>i 
and ending in Vj, then any arc joining T>i to T>j must start in XV Hence we can define a 
directed graph X>* with the strongly connected components of V as its vertices, and such 
that there is an arc from X>j to T>j in X>* if and only if there is an arc in X> starting in T>i 
and ending in Dj. Obviously that the directed graph X>* can not contain any cycles since 
otherwise the number of strongly connected components of T> will be equal to or less than 
m — 1. It follows that there is a strongly connected component, V>\ say, such that any arc 
that ends on a vertex in it must start at a vertex in it. Since X> is weakly connected, there 
is at least one arc that starts in T>\ and ends on a vertex not in T>\. Consequently, in X>i, 
the sum of in-degree of all vertices is less than the sum of out-degree of all vertices. This 
means that there must be a vertex in T> such that the weight balance condition can not 
be satisfied. Thus we have the contradiction. □ 
Hence, if a weighted directed graph is weakly connected and the weights of each agent 
satisfy the weight balance condition, then the directed graph must be strongly connected. 

3.1.1 Stability Analysis 

Before presenting the main results of this paper, we first prove the following important 
lemma. 

Lemma 1: Let A £ R nxn be any diagonal matrix with positive diagonal entries. Then 

(Aspan{l} ± ) n span{l} = 0, 

where 1 = (1, • ■ ■ , 1) T £ R n , span{l} is the space spanned by vector 1, and spanjl}- 1 is 
the orthogonal complement space of span{l}. 

Proof: Let p £ (Aspanjl} -1 ) flspanjl}. Then p £ span{l} and there is some q £ 
spanjlj^ such that p = Aq. It follows that q T Aq = q T p = 0. Since A is positive definite 
by assumption, we have q = and hence p = 0. □ 

Theorem 1: By taking the control law in (JBJ), under Assumption 2 and the weight 
balance condition, all agent velocities in the group described in (JTJ) become asymptoti- 
cally the same, collision avoidance can be ensured between all agents and the group final 
configuration minimizes all agent global potentials. 

Proof: Choose the following positive semi-definite function 

1 - 

i=l 

It is easy to see that J is the sum of the total artificial potential energy and the total 
kinetic energy of all agents in the group. Define the level sets of J in the space of agent 
velocities and relative distances 

fi= {(v\x ij )\J< c}. (7) 

In what follows, we will prove that the set Q is compact. In fact, the set such 
that J < c (c > 0) is closed by continuity. Moreover, boundedness can be proved under 
Assumption 1, namely, from J < c, we have that V 1 ^ < c. Potential V 1 ^ is radially 
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unbounded, so there must be a positive constant d such that < d, for all i,j 

1, ■ ■ ■ , N. In the same way, v tT v % < 2c/rrii } thus < y/2c/rrii. 

By the symmetry of V y ' with respect to x % i and x^ = — it follows that 

gyH dV ij dV ij 



dx^ dx l dxi ' 

and therefore 



(8) 



N , N 



dt 2 

i=i «=i 



Calculating the time derivative of J along the solution of system (JTJ), we have 
j=-^v er (T ! w ij {v i -v i ) \ =-v T {L®I n )v 

i=l ^ ' 



-V ((L + L T ) ® I n ) v, 



(9) 



where f = (v , • • • , v ) is the stack vector of all agent velocity vectors, L = [ly] with 

ij ~ 1 V w w, i = ? ( } 

is the Laplacian matrix of the weighted velocity neighboring graph, and (L + L T ) ® J n is 
the Kronecker product of L + L T and J n , with I n the identity matrix of order n. 

From the definition of matrix L, under the weight balance condition, it is easy to see 
that L + L T is symmetric and has the properties that every row sum is equal to 0, the 
diagonal elements are positive, and all the other elements are nonpositive. By matrix 
theory j2S], all eigenvalues of L + L T are nonnegative. Hence, matrix L + L T is positive 
semi-definite. By the connectivity of graph V, we know that L + L T is irreducible and 
the eigenvector associated with the single zero eigenvalue is ljy- On the other hand, it is 
known that the identity matrix I n has an eigenvalue jj, — 1 of n multiplicity and n linearly 
independent eigenvectors 

p 1 = [l,0,---,0] T , p 2 = [0,1,0,--- ,0] T , p n = [0,--- ,0,1] T 

By matrix theory [23], the eigenvalues of (L + L T ) <g> I n are nonnegative, A = is an 
eigenvalue of multiplicity n and the associated eigenvectors are 

q 1 = \p 1T r--,P 1T ] T ,---,Q n =\p nT ,---,P nT } T - 

Thus J < 0, and J = implies that all agents have the same velocity vector, that is, the 
vector Vk = (vl, ■ ■ ■ ,v£) (k — 1, • • • ,n), which is composed of every corresponding fcth 
component vl,---,vj? of v 1 , ■ ■ • , v , is contained in span{l}, where 1 = (1, ■ • • , 1) T G 
R N . It follows that x ij = 0, V(i, j) G iV x iV. 

We use LaSalle's invariance principle j2E| to establish convergence of system trajecto- 
ries to the largest positively invariant subset of the set defined by E = {v\ J = 0}. In E, 
the agent velocity dynamics are 

11* 1 

v l = —u l = V V x iV ij = V^V % 

rrii rrii z — ' rrii 
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and therefore it follows that 



-(M®I„ 



N 



-((MB) 



(11) 



where M = diagf— , ■ • • , ), and the matrix B is the incidence matrix of the position 
neighboring graph. Hence 



Vk 



n. 



-(MB)[V x ijV l3 ]k, k = l, 
Thus, Vk G range(MI?), k — 1, • • • , n. By matrix theory, we have 

range(M-B) = MrangeB = Mvimge(BB T ) = Mspan{l}- 

and therefore 

G Mspan{l} i , k = 1, • 
In any invariant set of E, by Vk G span{l}, we have 

Wfc G span{l}. 

By Lemma 1, we get from (fT2*|) and (fH3j) 



n. 



(12) 
(13) 



G (Mspanll}" 1 ) n span{l} = 0, k = 1, 



, n. 



Thus, in steady state, all agent velocities no longer change and from (jTTj) . the potential 
V 1 of each agent is globally minimized. Collision-free can be ensured between the agents 
since otherwise it will result in V i — > oo. □ 
Remark 1: If we take the control law for agent i to be 



u 



N 



(14) 



then the weight balance condition implies that, in the velocity neighboring graph, for 
each vertex, the number of arcs starting at it is equal to the number of arcs ending on it. 
When we take the control law in ()14jl . by using the same analysis method as in Theorem 
1, we can also obtain the same conclusion. 

Note that, from Q, we see that the interaction coefficients in control law © can 
influence the decaying rate of the total energy J. Hence, we conclude that the convergence 
rate of the system will be influence by the interaction coefficients. Explicit analysis on 
this topic will be presented in Section 4.1.3. 



3.1.2 Common Velocity 

In this section, we will show that the final common velocity can be obtained by the initial 
velocities of all agents. 

The position vector of the center of mass in system (0) is defined as 

_ Ej=i m i x 
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Thus, the velocity vector of the center of mass is 



Ei=i m i v 



By using control law ©, we obtain 



-1 



N r 



A' 



— V 



)+ X) v ^ iJ 



i=l L jeA/i 



By the symmetry of function V™- 7 with respect to x % \ under the weight balance condition, 
we get v* = 0. This means that, by using control law (JUJ), the velocity of the center of 
mass is invariant. 

Therefore, combining Theorem 1 and the analysis above, we have the following theo- 
rem. 

Theorem 2: By taking the control law in (|5jl. under Assumption 2 and the weight 
balance condition, the final common velocity is equal to the initial velocity of the center 
of mass, that is, the final velocity Vf is 



where v l (0) is the velocity value of agent % at initial time t — 0, % = 1, • • • , N. 

Remark 2: Note that, by the calculation above, we can see that the final common 
velocity is determined by the masses and the initial velocities of all agents, and does not 
rely on the neighboring relations and the magnitudes of the interaction coefficients under 
Assumption 2 and the weight balance condition. 

Remark 3: Even if the velocity neighboring graph is not connected, under the weight 
balance condition, the velocity of the center of mass is still invariant by using control law 
(JHJ). However, in this case, the final velocities of all agents might be different. In fact, 
when the velocity neighboring graph is not connected, under the weight balance condition, 
control law (JHJ) only ensures that all agents from the same connected group will have the 
same final velocity, and the final velocities of any two different connected groups might 
not be equal to each other. 

Remark 4: Using the control law in ©, from Theorems 1 and 2, we know that if 
the initial velocity of the center of mass is zero, the center of mass will not drift. All 
agents adjust their positions and velocities to minimize the total potential, and the final 
common velocity of all agents is zero. 

Hence, by using control law (JB|). under Assumption 2, the whole group can move ahead 
at a common nonzero velocity if and only if the initial velocity of the center of mass is 
not zero. 

Definition 4: The average velocity of all agents is defined as v = (Ei=i v l )/N. 
Remark 5: If we modify the control law u l to be 



E»=iW^(Q) 



N 




(15) 
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where m« and Wij are defined as before, by choosing the Lyapunov function 

1 - 

^E^+^A 

i=i 

under Assumption 2 and the weight balance condition, we can still get the results as in 
Theorem 1. Since the proof is similar to the proof of Theorem 1, we omit the details. 

Moreover, by using the control law in (|15|h under Assumption 2 and the weight balance 
condition, we can obtain that the average velocity of all agents in group Q is invariant 
and therefore the final velocity of the group is the average of the initial velocities of all 
agents, that is, 

„ Ef =1 ^(Q) 

Vf = N ' 

where u'(0) is the velocity value of agent i at initial time t = 0, % = 1, • • • , N. The final 
common velocity does not rely on the agents' masses, the neighboring relations, or the 
magnitudes of the interaction coefficients under Assumption 2 and the weight balance 
condition. 



3.1.3 Convergence Rate Analysis 

From the discussion above, we know that the coupling coefficients can influence the decay- 
ing rate of the energy function J, hence, we guess that the coupling coefficients can also 
influence the convergence rate of system (0). In the following, we will present qualitative 
analysis of the influence of the weights Wij on the convergence rate of the system. 

We consider the dynamics of the error system. From the discussion in 4.1.2, the 
velocity of the center of mass in system $1} is invariant. Thus, we define the following 
error vectors: 

= x i - x*, 
el = v i - v*, 

where x* and v* are the position vector and the velocity vector of the center of mass, 
respectively. Hence, the error dynamics is given by 



el = —u\ i — 

v rrii ' 



1 



rrii 



N 



N. 



By the definition of V 1 ^ and e l = x % — x*, we get 

V^^(||x^||) = V e ,^'(||e J i). 
By using the control law in (0), we obtain 



We choose the following positive semi-definite function 



1 - 



i=l 



(16) 



(17) 
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which is the energy function of the error system (jlfij) . (V*) 1 is the potential of agent i in 
(fTT)|) and it equals V 1 by the definition of potential function V % K 
Calculating the time derivative of J*, we have 

N 

j* = ~ J2 E <% e f (4 - ei) = -e T v {L ® I n )e v 

i=l j&Mi (18) 

= --el ({L + L T ) ® I n )e v , 

where e v = (e* T , • • • , e^ T ) T , and L and I n are defined as before. 

Using the same analysis method as in Theorem 1, we have J* < 0, and J* = implies 
that el = el = ■ ■ ■ = e„ . This occurs only when e\ = e\ = ■ ■ ■ = e^ = 0, that is, this 
occurs only when all agents have the same velocity. In other words, if there exist two 
agents with different velocities, the energy function J* is strictly monotone decreasing 
with time. Certainly, before the group forms the final tight configuration, there might be 
the case that all agents have the same velocity, but due to the regulation of the potentials 
among agents, it instantly changes into the case that not all agents have the same velocity 
except when the group has achieved the final stable state. Hence, the decaying rate of 
energy is equivalent to the convergence rate of the system. It is easy to see that when all 
agents have not achieved the common velocity, for any solution of the error system (|16|). 
e v must be in the subspace spanned by eigenvectors of (L + L T ) ®I n corresponding to the 
nonzero eigenvalues. Thus, from (fTHj). we have J* < — A 2 e^e„, where A 2 denotes the second 
smallest real eigenvalue of matrix L + L T . Therefore, we have the following conclusion: 
The convergence rate of the system relies on the second smallest real eigenvalue of matrix 
L + L T with L defined as in (ITU1) . 

3.2 Nonideal case 

We know that, in some cases, the velocity damping should not be ignored. Then, if we 
still take control law ©, what will be the motion of the group? In fact, in this case, the 
total force acting on the ith agent is 

N 

w^-E^-^- E Vx'Vf-kiV 1 , (19) 

where Wij and ki are defined as before. 

The following theorem shows the motion and the final configuration of the group. 

Theorem 3: By taking the control law in under Assumption 2 and the weight 
balance condition, all agent velocities in the group described in Q become asymptotically 
the same, all agents finally stop moving, collision avoidance can be ensured between all 
agents, and the group final configuration minimizes all agent global potentials. 

Proof: Taking the Lyapunov function J defined as in Theorem 1, that is, 

1 - 

J = -E^ + miD^')- 

i=l 

We can show analogously that the set Q = {(v\x^)\J < c} (c > 0) is compact. 
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Calculating the time derivative of J, we have 

j = -^v T {(L + L T ) ®I n )v- v T (H <g> I n ) v, 

where v and L are defined as in Theorem 1, and H = diag(fci, • ■ • , k^) with ki > is the 
velocity damping gain. It is easy to see that H is positive definite. Using the same analysis 
method as in Theorem 1, we know that J < 0, and J = implies that v 1 = ■ ■ ■ = v and 
they all must equal zero. We denote E* = {v \ J = 0}. In E*, the agent velocity dynamics 
become 

1 - 1 

v* = V V x rV ij = V x iV\ 

nii z — ' rrii 

Following the proof of Theorem 1, we can conclude that Vk = 0, hence if = 0, i = 
1, • • ■ , N, which means that the agent velocity no longer changes in steady state. All 
agents will finally stop moving, and the final configuration minimizes all agent global 
potentials. Furthermore, during the course of motion, collisions can be avoided between 
the agents. □ 
Remark 6: It can be shown that if we use control law (jl5|) . we can still obtain all 
results in Theorem 3. 

Remark 7: From Theorem 3, we know that due to damping, all agents eventually stop 
moving. This is because when all agents eventually move ahead at a common velocity, 
control input (JBJ) equals zero. 

In order to make the group have the same properties as in ideal case, the control laws 
should contain the velocity damping term. Hence, we modify the control scheme to be 
(HJ), where a 1 and (3 l are defined as in (jUJ). Then, the actual total force acting on agent i 
is 

JV 

Following Theorems 1 and 2, we can easily obtain the same stable flocking motion and 
the final common velocity, that is, when the velocity damping is taken into account, by 
using control scheme (@J), under Assumption 2 and the weight balance condition, all agent 
velocities in the group described in (JHJ) become asymptotically the same, collision-free can 
be ensured between all agents, the group final configuration minimizes all agent global 
potentials, and the final common velocity is equal to the initial velocity of the center of 
mass. 

4 Simulations 

In this section, we will present some numerical simulations for the system described in 
Q in order to illustrate the results obtained in the previous sections. 

These simulations all are performed with ten agents moving on the plane whose initial 
positions, velocities and the velocity neighboring relations are selected randomly, but they 
satisfy: 1) all initial positions are chosen within a ball of radius R = 15[m] centered at 
the origin, 2) all initial velocities are selected with arbitrary directions and magnitudes in 
the range of (0, 10)[m/s], and 3) the velocity neighboring graph is connected. All agents 
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have different masses to each other and they are randomly selected in the range of (0, 
l)[kg]- 

Note that, because the position neighboring graph is complete, we will not describe 
it. In the following figures, we only present the velocity neighboring relations. 

Figs. 1-6 show the results in one of our simulations, where the control laws are taken 
in the form of (jOJ with the explicit potential function 

V ij = -ln||^'|| 2 + „ 5 „ , i,j = I,.-. ,10. 

10 10 

The interaction coefficient matrix W is generated randomly such that Wy = Wji, 

3=1 3=1 

Wa = 0, and the nonzero Wij satisfy < Wij < 1 for all i,j = 1, • • • , 10. We run the 
simulation for 200 seconds. 

In Figs. 1-4, the blue lines all represent the bidirectional neighboring relations and 
the red lines with arrows represent the unidirectional neighboring relations. Fig. 1 shows 
the group initial state which includes the initial positions, velocities and the velocity 
neighboring relations. Figs. 2 and 3 depict the motion trajectories of all agents and the 
configurations of the group, respectively, where the black solid arrow direction represent 
the motion direction of the agents, and the dotted lines represent the agent trajectories. 
In order to indicate the influence of potential function on the group cohesion and con- 
figuration, we present the group configuration in Fig. 2 at time t = 60s. It can be seen 
from Figs. 2 and 3 that, during the course of motion, all agents regulate their positions to 
minimize their potentials and regulate their velocities to become the same. Fig. 4 shows 
the final steady state configuration and the common velocity at t = 200s. By numer- 
ical calculation, we can obtain that all agents achieve the same velocity approximately 
at t — 128.92s and the final common velocity equals the initial velocity of the center of 
mass. In Fig. 5, the star represents the initial position of the center of mass, and it can 
be seen from it that the velocity of the center of mass is invariant. Fig. 6 is the velocity 
curves. The solid arrow indicates the tendency of velocity variation. Fig. 6 distinctly 
demonstrates that all agent velocities asymptotically approach the same. 

Hence, numerical simulation also indicates that, by using the control law in under 
the assumption of the connectivity of the velocity neighboring graph and the weight 
balance condition, stable flocking motion can be achieved. 

For the case that the initial velocity of the center of mass is zero, we also perform some 
simulations. Fig. 7 is one of them and we run its associated simulation for 3000 seconds. 
In Fig. 7, the star represents the position of the center of mass. In the simulation, the 
center of mass is always stationary, the final configuration no longer changes, the whole 
group does not drift, and all agents finally stop moving. 



5 Conclusions 

In this paper, we have investigated the collective behavior of multiple mobile agents 
moving in n-dimensional space with point mass dynamics and introduced a set of control 
laws which enable the group to generate stable flocking motion. We analyzed the group 
properties in two different cases, respectively. When we ignored the velocity damping, 
using a coordination control scheme, we can make the group generate stable flocking 
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motion. The control laws are a combination of attractive/repulsive and alignment forces 
and the control law acting on each agent relies on the position information of all agents 
in the group and the velocity information of all its neighboring agents. The control laws 
ensure that all agent velocities become asymptotically the same, collisions can be avoided 
between all agents, and the final tight formation minimizes all agent global potentials. 
Moreover, we analyzed the magnitude and direction of the final velocity and showed that 
the final common velocity is equal to the initial velocity of the center of mass of the 
system. When the velocity damping is taken into account, in order to generate stable 
flocking, we properly modified the control scheme such that the velocity damping was 
cancelled by some terms in the control laws. Finally, numerical simulations were worked 
out to further verify our theoretical results. 

6 Appendix: Graph Theory Preliminaries 

In this section, we briefly summarize some basic concepts and results in graph theory that 
have been used in this paper. More comprehensive discussions can be found in [2Tj . 

A undirected graph Q consists of a vertex set V = {ni,n 2 , • • • ,n m } and an edge set 
£ = {(ni,rij) : ni,rij G V}, where an edge is an unordered pair of distinct vertices of V. 
If rii,nj G V, and (rii,rij) G £, then we say that rii and rij are adjacent or neighbors, 
and denote this by writing rij ~ n^. A graph is called complete if every pair of vertices 
are adjacent. A path of length r from rii to rij in a undirected graph is a sequence of 
r + 1 distinct vertices starting with rij and ending with rij such that consecutive vertices 
are adjacent. If there is a path between any two vertices of Q, then Q is connected. In 
this paper, we always assume that the graph is simple graph, which means that there 
is no self-loops and each element of £ is unique. An oriented graph is a graph together 
with a particular orientation, where the orientation of a graph Q is the assignment of 
a direction to each edge, so edge (rii, rij) is an directed edge (arc) from n { to rij. The 
incidence matrix B of an oriented graph Q is the {0, ±l}-matrix with rows and columns 
indexed by the vertices and edges of Q, respectively, such that the zj-entry is equal to 1 
if edge j is ending on vertex rii, -1 if edge j is beginning with vertex rii, and otherwise. 
Define the Laplacian matrix of Q as L(Q) = BB T . L(Q) is always positive semi-definite. 
Moreover, for a connected graph, L(Q) has a single zero eigenvalue, and the associated 
right eigenvector is l m . 

A directed graph T> consists of a vertex set V = {rii, ■ ■ ■ ,n m } and an arc set £ = 
{(rii,nj) : ni,nj G V}, where an arc, or directed edge, is an ordered pair of distinct 
vertices of V. In this paper, we always assume that rii 7^ n j, meaning that there is no 
self-loops, and assume that each element of £ is unique. Let V = (V,£,A) be a weighted 
directed graph. A = [a^] is the weighted adjacency matrix, where is the weight of arc 
{rii, n j), a ij > for all i,j G X = {1, • • • , m}\ i ^ j and a„ = for all i G X. The set of 
neighbors of vertex n« is defined as M% = {j G X : > 0}. The in-degree and out-degree 
of vertex n« are, respectively, defined as 



The weighted graph T> Laplacian matrix is defined as L(T>) = A — A, where A is the degree 
matrix of T> which is a diagonal matrix and its ith diagonal element is A# = deg out (rii). 



in 



in 
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By definition, A = is an eigenvalue of the Laplacian matrix L(T>) and l m is its associated 
right eigenvector. A path of length r from n to n r in a directed graph is a sequence of 
r + 1 distinct vertices starting with n and ending with n r such that (n k _i,n k ) is an arc 
of V for k — 1, • • • , r. A weak path is a sequence of n , ■ ■ ■ ,n r of distinct vertices such 
that for k — 1, • • • , r, either (n^-i, n^) or (n^, n^i) is an arc. A directed graph is strongly 
connected if any two vertices can be joined by a path and is weakly connected if any two 
vertices can be joined by a weak path. 
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